Automated synthesis of steady-state continuous processes using reinforcement learning
نویسندگان
چکیده
Abstract Automated flowsheet synthesis is an important field in computer-aided process engineering. The present work demonstrates how reinforcement learning can be used for automated without any heuristics or prior knowledge of conceptual design. environment consists a steady-state simulator that contains all physical knowledge. An agent trained to take discrete actions and sequentially build up flowsheets solve given problem. A novel method named SynGameZero developed ensure good exploration schemes the complex Therein, modelled as game two competing players. plays this against itself during training artificial neural network tree search forward planning. applied successfully reaction-distillation quaternary system.
منابع مشابه
Reinforcement Learning Using Gaussian Processes for Discretely Controlled Continuous Processes
In many application domains such as autonomous avionics, power electronics and process systems engineering there exist discretely controlled continuous processes (DCCPs) which constitute a special subclass of hybrid dynamical systems. We introduce a novel simulation-based approach for DDCPs optimization under uncertainty using Reinforcement Learning with Gaussian Process models to learn the tra...
متن کاملContinuous-Domain Reinforcement Learning Using a Learned Qualitative State Representation
We present a method that allows an agent to learn a qualitative state representation that can be applied to reinforcement learning. By exploring the environment the agent is able to learn an abstraction that consists of landmarks that break the space into qualitative regions, and rules that predict changes in qualitative state. For each predictive rule the agent learns a context consisting of q...
متن کاملManifold Representations for Continuous-State Reinforcement Learning
Reinforcement learning (RL) has shown itself to be an effective paradigm for solving optimal control problems with a finite number of states. Generalizing RL techniques to problems with a continuous state space has proven a difficult task. We present an approach to modeling the RL value function using a manifold representation. By explicitly modeling the topology of the value function domain, t...
متن کاملContinuous-State Reinforcement Learning with Fuzzy Approximation
Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. There exist several convergent and consistent RL algorithms which have been intensively studied. In their original form, these algorithms require that the environment states and agent actions take values in a relatively small discrete set. Fuzzy representations for approximate, model-free RL have been proposed i...
متن کاملOnline Reinforcement Learning for Real-Time Exploration in Continuous State and Action Markov Decision Processes
This paper presents a new method to learn online policies in continuous state, continuous action, model-free Markov decision processes, with two properties that are crucial for practical applications. First, the policies are implementable with a very low computational cost: once the policy is computed, the action corresponding to a given state is obtained in logarithmic time with respect to the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Frontiers of Chemical Science and Engineering
سال: 2021
ISSN: ['2095-0187', '2095-0179']
DOI: https://doi.org/10.1007/s11705-021-2055-9